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We prove the equivalence among symmetricity, time 
reversibility, and zero entropy production of the station- 
ary solutions of linear stochastic differential equations. A 
sufficient and necessary reversibility condition expressed 
in terms of the coefficients of the equations is given. The 
existence of a linear stationary irreversible process is es- 
tablished. Concerning reversibility, we show that there 
is a contradistinction between any 1-dimensional station- 
ary Gaussian process and stationary Gaussian process of 
dimension n > 1. A concrete criterion for differentiat- 
ing stationarity and sweeping behavior is also obtained. 
The mathematical result is a natural generalization of 
Einstein's fluctuation-dissipation relation, and provides a 
rigorous basis for the isothermal irreversibility in a linear 
regime which is the basis for applying Onsager's theory 
to macromolecules in aqueous solution. 
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1. INTRODUCTION 



The stochastic differential equation 



— = b{x)+m), 



xeR' 



in 



(1) 



with r being a nonsingular matrix and ^{t) being the "derivative" of a 
n-dimensional Wiener process, has wide apphcations in science and engi- 
neering [9]. One standard method for attacking this equation is by finding 
the fundamental solution to its corresponding Fokker-Planck (Kolmogorov 
forward) equation 



a parabolic equation for the transition probability P{x, t\x^) defined on the 
entire i2" with the integrability condition 



That is P e L'^[R'"]. With this condition, it has been difficult to obtain 
detailed, rigorous understanding of the partial differential equation (PDE) 
in (2). However, for a class of PDE satisfying the regular conditions for the 
Cauchy problem, which include linear b{x), the existence and uniquess of 
a positive fundamental solution is guaranteed. Furthermore, the existence 
and uniqueness of the solution to the Cauchy problem with initial data 
f{x) {\,f{x)\ < ce"l^l with constant c > and a > 0) is proven. The above 
mentioned regular condition for Cauchy problem and its consequences can 
be found in [6]. In addition, a result on the nonexistence of a stationary 
solution in L^, called sweeping, is also obtained. This is stated as follows 



Assume that the coefficients of equation (2) are regular for the Cauchy 
problem. Further assume that all stationary nonnegative solution of (2) 
and (3) are of the form cu{x) where u{x) > almost everywhere and c is 
a nonnegative constant. Then the solution of (2) is either asymptotically 
stable or sweeping. Asymptotic stability occurs when 




(2) 




(3) 



[6]: 




and sweeping when I = co. 
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The condition in this sweeping theorem is satisfied because of the unique- 
ness and positivity of the fundamental solution to (2) and the correspond- 
ing Cauchy problem [6]. No criterion has been given to assert when the 
sweeping or asymptotically stable behavior indeed occurr. 

In this paper, we show that this problem can be completely solved for 
linear b{x). A sufficient and necessary condition for the sweeping behavior 
is obtained. Within the nonsweeping case, the stationary processes can be 
further classified as either reversible or irreversible. A series of sufficient 
and necessary conditions, and a criterion based on the cocfficnts of (1) arc 
derived for this classification. The distributions concerned are all Gaussian. 
In the case of n = 1, Gaussian stationary processes are necessarily reversible 
[24]. Part of our results, thus, may be regarded as a further development 
of this theorem for arbitrary n > 1. 

The stochastic differential equation given in (1) defines a Markovian pro- 
cess known as diffusion. This theory has been a well accepted mathematical 
model for the statistical behavior of molecular systems, following the work 
of Einstein, Ornstein and Uhlenbeck, Onsager, Keizer, and other physcists 
[23, 2, 8, 12, 13]. One of the central pieces in the physicists' work is the 
fluctuation-dissipation relation. Until now, however, the role of this deep 
relationship has not led to any mathematical conclusion in the theory of 
stochastic differential equation. 

It turns out, the fluctuation-dissipation relation naturally emerges from 
the mathematical results of the present paper. We will show that the stan- 
dard fluctuation-dissipation relation is a necessary but not a sufficient con- 
dition for time-reversibility. Our reversibility condition, on the other hand, 
can be viewed as a stronger form of fluctuation-dissipation relation which 
also has a closer resemblance to Einstein's original one. Time-reversibility 
is an important concept in which the physicists are interested. In connec- 
tion to this end, we introduce the concept of entropy production rate, derive 
its analytical expression and prove that in a stationary process it is zero 
if and only if the process is reversible. Finally, we provide the condition 
under which a stationary irreversible Gaussian process exists. 

2. THERMODYNAMICS, HEAT DISSIPATION, AND 
ENTROPY PRODUCTION RATES 

In recent years, with the increasing number of applications of the stochas- 
tic model (1) or (2) to a wide range of macromolecular processes [4, 5, 14, 
15], it has become evident that an axiomatic isothermal thermodynamic 
formalism can be established based on the stochastic diff'crcntial equation. 
In this section, we give a brief introduction of this emerging theoretical 
framework we called stochastic macromolecular mechanics [15]. 
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Following Lebowitz and Spohn [7], we introduce the instananeous heat 
dissipation functional Wt [16]: 

dWt = {A/2)-^b{Xt) o dXt = 2A-^b{Xt) -dXt + V- b{Xt)dt (4) 

whore o denotes the integral in the Stratonovich sense. According to this 
definition, the heat dissipation, the left-hand-side of (4), is equal to the 
work done by the system, the right-hand-side of (4). The work is the 
product of force and displacement; the force is the product of the frictional 
coefficient {2A~^) and velocity b{x). This is the law of energy conservation. 
It then follows that the mean rate of the heat dissipation 

hdr = [Wt] = [ 2(A-^b(x)) ■ Jdx (5) 
dt Jpj^ 



in which 



A\IP{x,t) +b{x)P{x,t) 



2 



denoting the probability flux in (2): dP{x.t) / dt = —V - J, and the proba- 
bility density P{x,t) is the solution to (2). In mechanical terms, the mean 
heat dissipation rate is the product of force {2A~^b{x)) and flux (J) [8]. 

The thermodynamic force of Onsager is different from the mechanical 
force 2A~^b{x). In terms of (2), the Onsager's thermodynamic force n(a;), 
called aflanity by chemists, is [4] 

, , , / P(x + dx,t\x)P(x) \ 
U{x) ■ dx = log , ,' ' ; ^ \ , (6) 

^ ^ ^\P{x,t\x + dx)P{x + dx) J ^ ' 

« [2 A-^b{x) -y log P{x)] ■ dx 

in which « is valid for small dx. Therefore, the thermodynamic force II 
and flux J are related by J = ^ATl, in which the matrix A is symmetric. 
This relation reflects the Onsager's reciprocal relations [10]. When apply- 
ing (1) to molecular motors, a subspace of x represents the internal motion 
of a macromolecule, and the remains of the x represents the external move- 
ment of the entire macromolecule [11]. Hence the relation between J and 
n reflects a certain symmetry between the chemical flux, the mechanical 
movement, the chemical energy source, and the mechanical work in the 
energy convcrtion. 

We now introduce another two important thermodynamic quantities: 
the entropy and entropy production rate (epr). The resulting analytical 
expression will then be used as a rigorous definition for the remains of the 
paper. 
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We use the well-known definition for entropy 

e[P] = - ( P{x, t) log P{x, t)dx (7) 
J 

which is a functional of the probability density P{x, t), the solution of (2). 
The rate of the increase of entropy is 

e[P] = [ (\ogP + l)V-J dx 
JR" 

= - [ P-\VP - 2A-^b(x)P) -Jdx- [ 2A-^b(x) ■ J dx 
JR" JR" 

= / n • Jrfx - / 2A-^b{x) ■ Jdx (8) 

J RT' J RT 

= epr — hdr. 

In the derivation, we used equation (2) and integration by parts, assumed 

no flux boundary condition and matrix A being nonsingular. It is meaning- 
ful from the thermodynamic point of view to identify the first term in (8) 
with the entropy production rate which equals to the product of thermo- 
dynamic force and flux, and the second term is exactly the heat dissipation 
rate. In a time independent stationary state, the e = 0, and the entropy 
production is balanced by the heat dissipation. This is the case for an 
isothermal noncquilibrium steady-state. 

For a single macromolecule immersed in a fluid with constant tempera- 
ture, our epr in (8) is related to Onsager's dissipation function epr/2 = 
our hdr is his S* , and our e is his S. Therefore, (8) corresponds to 
5 = 2$ — 5* in which 2$ is a "source" term, entropy production, S* 
is the heat giving out by the system to the surrounding fluid, and S is the 
entropy change of the system proper. 

We now define the entropy production rate and time reversibility. 

Definition 2.1. The entropy production rate, epr, of a stationary 
diffusion process defined by (1) is 

^ y (V log P{x) - 2A-^b{x)fA{V log P{x) - 2A-^b{x))P{x)dx. (9) 



It is seen that the epr is always non- negative. This is the second law 
of thermodynamics. This paper is to establish a mathematical relationship 
between epr = and the time reversibility defined as follows: 

Definition 2.2. A stationary stochastic process {x{t);t e R} is time 
reversible if for every positive integer m and every ti,t2,---,tm G R, the joint 
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probability distribution 

P{x{ti),x{t2), ...,x{tm)) = P{x{-ti),x{-t2),...,x{-tm))- 



Eq. 9 also indicates that the epr equals zero if and only if 2A~^b = 
VlogP. That is the force 2A~^b being conservative with a potential: 
2A~^b = -VZ7. For systems satisfying the potential condition, the ther- 
modynamic force n also has a potential, 11 = -V(C/(a;) + log P(a;)), whose 
expectation is precisely the Helmholtz free energy: 



*[P] = E[U{x) + log P{x)] 

= [p{x,t)U{x)dx-e[P\. 
J 



(10) 



in which the first term is the mean internal energy. It is easy to show that 
^ = —epr < 0: the free energy increases and reaches its maximiim at an 
equilibrium. It turns out that "if is related to the relative entropy [17], and 
it is well-known that relative entropy is a Lyapunov function for Eq. 2 [6] . 
Finally, with the potential condition, the heat dissipation functional dWt 
= dU{Xt), the internal energy fluctuation. Hence, Wt is stationary and 
its expectation and variance are the internal energy and heat capacity of 
a single macromolecule at thermal equilibrium. A thermal equilibrium is 
necessarily time reversible. 



3. LINEAR THEORY OF REVERSIBLE STATIONARY 

PROCESSES 

Let's consider the linear stochastic diff'erential equation of order n: 



where 





' Xi{t) ' 




'bn ■■ 


■ bin 




111 • 


• 7l»i 


x{t) = 




, B = 














_ Xn{t) _ 




_bnl ■■ 


bnn 




. 7nl • 





is nonsingular, and 



.Ut) 



(11) 



(12) 



(13) 
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is the "white noise" vector which should be considered, from a mathemat- 
ical point of view, as the derivative of a n-dimensional Wiener process. 
Formally, wc have E[(_{t)£^'^ {t')] = S{t — t')I where / is the identity matrix. 

Heuristically speaking, near any stable fixed point of b{x) = in a non- 
linear (1) there is a linear approximation in the form of (11). Therefore, 
the mathematical analysis presented in the present paper can be considered 
as the linear theory near such fixed point for the nonlinear system. The 
linear approximation leads to a Gaussian process defined by (11). 

The probability density of the solution of (11), P{x,t), satisfies the 
Fokker-Planck equation 



where A = FF^, which is positive definite since we assume F is nonsingular. 

Hence (14) is uniformly parabolic. 

Theorem 3.1. The following five statements about (11) are equivalent: 

(i) Its B and TT^ = A satisfy a symmetry condition A~^B = {A~^B)'^ 
which is positive definite; 

(a) It has a stationary Gaussian solution with a symmetric two-time 
covariance matrix R{t,t') =E[x{t)x'^ {t')]; 

(Hi) It defines a time reversible stationary process; 

(iv) Its corresponding elliptic operator (the right-hand-side of (14)) is 
symmetric with respect to a positive function w~^{x), w{x) G L^; 

(v) Its stationary process has zero entropy production rate (epr). 

Remark 1: According to [6], the stationary process mentioned above is 
unique. 

Remark 2: The statement (i) is also equivalent to A^^Bx having a 
potential function U{x) = ^x^A~^Bx and Jj^n e~^^''^dx < oo. The re- 
versibility under this potential condition has been announced for the gen- 
eral nonlinear equation (1) but without proof [19, 11], and discussed in 
[3, 18] for the equation on compact manifold. In this paper, we provide a 
simple proof for the linear case. 

Proof, (i) (ii). The symmetry and positive definiteness oi A~^B= 
T~^T~^B implies that F~^BF is also symmetric and positive definite. 

Hence there exists an orthogonal matrix Q, = Q^^. such that F^^i?F = 
QAQ~^ where A is a diagonal matrix with all positive eigenvalues Ai , A2, A, 
Thus 




(14) 



B = FQAQ-T 



IT.-1 



(15) 
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which has the same A's as eigenvalues. Hence it is nonsingular. Substituting 
(15) into (11), we have 



| = -A..C(.) 



(16) 



where y = Q^T-^x, C(t) = Q^m, and E[at)e{t')] = Eme{t')] = 
5{t — t')I. (16) is completely diagonalizcd. Its solution are n Ornstein- 
Uhlenbeck processes each with transition probability 



and stationary distribution 

nvi) = 

where 



1 



2-KU>i(t) 



1 



exp 



2'KUJi{0Q) 



1 



exp 



(17) 



(18) 



Furthermore, the two-time covariance matrix for the stationary process is 

(19) 



Therefore, by substituting y = Q^T back into the above equations, we 
have 



P{x,t\x°) 



in which matrix 



\E\\ 



exp 



1 



(x-e-^V)^^(i)(x-e-^V) 



(20) 



£-i(t) = i(/-e-2Bt^5-ippT 

The stationary covariance S = E^"^ {co)~^B^^ A gives a stationary Gaus- 
sian distribution. Combining with the transition probability in (20) and 
Markovian properties, a Gaussian stationary process with covariance S is 
obtained for (11). 

Finally, substituting y — F^^x back into (19), the stationary two-time 
covariance matrix 

R{t,t') = E[x{t)x'^ it')] = ie-^l*-*'IS-iA. 
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We now show that R{t,t') is symmetric. A = A ^ immediately 
leads to BA = AB^, which gives: 

B"A = B'^-^AB'^ = B'^-'^A{B'^f = ... = 

That is B^A = for any interger n. Therefore matrix R{t,t') is 

symmetric. 

(ii) (iii)- A Gaussian process x{t) is completely determined by its 
expectation E[x{t)] and covariance E[x{t)x'^ {t')]. A stationary Marko- 
vian Gaussian process is completely determined by the joint distribution 
P{xi,xo). The Gaussian P(xi,a:o) is determined by all its first and sec- 
ond moments, among which are the two-time covariance matrix R{t, 0) = 
E[x{t)xQ]. Therefore, the symmetric matrix R{t,t')= R{\t — t'\,0) leads 
to P{xi,Xo) = P{xo,Xi); and with the Markovian property the stationary 
Gaussian process is then time reversible.^ 

(iii) =J> (iv). For a stationary Markov process x{t), the joint probability 
distribution P{x{ti), x{t2), x{tm) is uniquely determined by the station- 
ary distribution Peq{x) and the transition probability P{y,t\x). By the 
standard method in probability, the time reversibility implies [20] 

(l){x)P{x,t\y)Peq{y)'ip{y)dxdy 



R"JR 



^ ^{y)P{y, t\x)Peq{x)ct>{x)dxdy (21) 
RT 

being valid for arbitrary (f>,tp D[R"] where D is the space of smooth 
functions with compact supports. Note that P{y,t\x) is the fundamental 
solution to (14), 

I (y^„ P{y,t\x)f{x)dx^ = my)] 

where the differential operator 

C[f{x)]=V-i^AVf + Bxf). (22) 



-"^It is interesting to compare the cases of n = 1 and n > 1: It is known in statistics 
literature [24] that any 1-dimensional stationary Gaussian process is necessarily time 
reversible, and any n-dimensional stationary Gaussian process can be realized as a so- 
lution of (11) [21]. Our result shows that for n > 1 the reversibility does not generally 
hold. 
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Differntiating both sides of (21) with respect to i at f = 0, we have 

(l>{x)C[Pegix)iP{x)]dx = j J{v)C[PMcj>{y)]dy. (23) 



let f{x) = (j){x)Peq{x) and g{x) = ip{x)Pf.q{x), then / and g are two arbi- 
trary functions in S. Since Peq{x) > 0, 

p-\x)f{x)C[g{x)]dx = [ p-\y)g{y)C[f{y)]dy. (24) 

Therefore, the operator £ is symmetric with respect to the reciprocal of 
its stationary distribution Peg (a;): w{x) = Peq{x). This result is known to 
physicists. 

(iv) => (v). The differential operator C in (22) can also be rewritten as 

m = ^ V • (AVf) + {Vf)Bx + Tr[B]f 

where Tr[B] is the trace of the matrix B. The statement {iv) 

J e''gC[f]dx = J e^'fCigjdx, 

in which the positive 'w{x) = , f and g G S are arbitrary functions, 
leads to 



iv • (AV/) + {Vf)Bx 



dx = / e^/ 



iv • (AVg) + {Vg)Bx 



dx. 



Through integration by parts, the first term on the left-hand-side (and 
similarly for the right-hand-side) 

j e"" gW ■ {AV f)dx = - J e"" {Vg)A{V f)dx - J e''g{VU)A{Vf)dx, 



and we have 

"1 



J e^g 1(V?7)A(V/) - {V f)Bx dx = J f 
By a simple rearrangement, we have 

J e^(<?V/ - fVg){^AVU - Bx)dx = 0. 



^{VU)A{Vg)-{Vg)Bx 



dx. 
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Since / and g are arbitrary, we have \AVU — Bx = in which U = — logw. 
Therefore 



that is epr = 0. 

(v) => (i). In (9) A is positive definite. Hence the integrand is always 

positive, therefore epr = implies 2A^^Bx = — VlogPeq(x). Therefore 
is a symmetric matrix. Furthermore, Peq 

is a normal density and 

hence, Peq G => A~^B is positive definite. | 

Corollary 3.1. A reversible stationary Gaussian solution to (11) has 
its covariance matrix S = ^B^^A wliere B has to have all its eigenval- 
ues being real and positive. It has a symmetric two-time covariant matrix 
R{t,t') = e~^l*~* Is, and its entropy production is zero. 



4. LINEAR THEORY FOR IRREVERSIBLE STATIONARY 

PROCESSES 

In the previous section, we have shown that a symmetric A~'^B in (14) 
is a necessary and sufficient condition for reversibility of the stationary 
solution of (11). The result also implies that all the eigenvalues of matrix 
B are necessarily positive. In this section, we consider the situation when 
such symmetric condition is absent. One interesting class of problems is 
when matrix B has complex eigenvalues. 

Definition 4.1. A linear stochastic system characterized by (11) and 
satisfies the statments in Theorem 3.1 is called reversible. A system which 
is not reversible is called irreversible. 



Lemma 4.1. Fokker-Planck equation (14) with positive definite A but 
unrestricted B has an unique fundamental solution. The solution is Gaus- 
sian with 



where Ax{t) = x{t) - E[x{t)]. 

Proof. The proof relies on a direct verification of the Gaussian function 
with (25) as a solution to equation (14). This has been done many times by 
physicists [8, 21]. Hence we will not repeat the lengthy computation. With 



Vlogw(a;) + 2A~^Bx = 0, 
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the verification of the solution, and uniqueness of the fundamental solution 
to (14), the lemma is proven. | 

Theorem 4.1. The necessary and sufficient condition for nonsweeping 
is that matrix B has all its eigenvalues with positive real parts. 

Proof. Necessity; If the solution to (14) is nonsweeping, then by the 
Lemma 4.1 and the sweeping theorem from Section 1, its fundamental 
solution has a stationary limit e L^. Since x{t) has Gaussian distribution 
for t, the limit distribution is also Gaussiani with finite variance. Therefore, 



By the general formula for e~^* [1] and using A = TT^ , the convergence 
of (26) implies that all the eigenvalues of B in (25) must have positive real 
parts. 

Sufficiency: If all the eigenvalues have positive real parts, the nonstation- 
ary Gaussian solution in (25) has a unique Gaussian density as its limit 
when i — > CX3. With the help of the fundamental solution for equation (14) 
and the Markovian property, a stationary Gaussian process related to the 
quantities in (25) can be constructed. Hence the solution of (14) are non- 
sweeping. I 

Corollary 4.1. The necessary and sufficient condition for a stationary 
Gaussian process to he irreversible is the matrix B in (11) has all eigen- 
values with positive real parts and A~^B is nonsymmetric. 



5. A STRONG FORM OF FLUCTUATION-DISSIPATION 

RELATION 

We now limit our discussion to nonsweeping situation with and without 
reversibility. We first give 

Definition 5.1. The matrix relation among B, T in (11), and the 
stationary covariance S of x{t) 



lim E[Ax{t)Ax{t)'^] < oo. 



(26) 



rr"^ ^ BE + EB^ 



is called standard fluctuation-dissipation relation. Actually, 



H = lim 




ds. 
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Combining the above Theorem 3.1 and Corollary 4.1, we immediately 
have the following corollary. 

Corollary 5.1. The standard fluctuation- dissipation relation is a nec- 
essary but not sufficient condition for the reversibility of system (11). For 
a reversible system, it can be simplified into a stronger form 

A = 2BS. (27) 



Proof. By Theorem 3.1, (11) with reversibility has symmetric V^^T~^B] 
and by Corollary 3.1 its stationary process has covariance S = ^B~'^TT'^ . 
Therefore, B'E = \TT^ is symmetric, and 

rr"^ = = BE + SS"^. (28) 



Hence, the standard fluctuation-dissiplatin relation follows, and further- 
more (28) can be simplified into A = 2BE. 

On the other hand, the standard fluctuation-dissipation relation is sat- 
isfied by any stationary Gaussian processes with or without the symmetric 
A~^B: Prom (25) we have 



ds]B' = - 



Let f — > 00, the upper limit vanishes and we have 

BE + EB^ = A. 







Hence by Corollary 4.1 it is not a sufficient condition for reversibility. | 

(27) has a close resemblance to Einstein's original fluctuation-dissipation 
relation, in which A is the covariance of the fluctuating white noise, B is 
the dissipative linear relaxation rates, and E is the equilibrium covariance 
(kT). 



6. THE ONSAGER'S HYPOTHESIS AND GREEN-KUBO 

FORMULA 

The following statement is known as Onsager's hypothesis or Green- 
Kubo formula [10]. 

Theorem 6.1. If a system, in (11) is reversible, the conditional expecta- 
tion E[x{t)\xo\ and the two-time covariance of its stationary solution have 
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identical time dependence in the following sense: 

E[x{t)\xo] = e-^*xo, R{t, 0) = 6'^% (29) 

where S = Elxx"^] is the covariance of the stationary solution. 

Proof. The proof of this result is contained in the proof of Theorem 3.1, 
(i) =^ I 

Remark: This is Onsager's original statement [10]. However, the state- 
ment is not limited to reversible systems, it is also applicable to nonsweep- 
ing irreversible systems: 

R{t,0) = E,, [E[x\xo\ 4] = E,, [e-^*a:o4] = e"''*S. 

Indeed, this result which relies solely on the first equality in (29) is in fact 
a consequence of the linearity of equation (11). 
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